Real-Time Spotting Recognition of Gesture Motion Image and Spontaneous Speech
نویسندگان
چکیده
A spotting algorithm is proposed to recognize the meanings of 1) human gestures from motion images, 2) spontaneous speech. The spotting algorithm removes the need for temporal segmentation of gesture/utterance duration and introduces frame-wise recognition suitable for realizing a real-time system. We carried out some experiments into gesture/utterance recognition and the results have confirmed that: 1) for gesture motion images our algorithm is robust with various clothing textures and backgrounds, 2) for spontaneous speech our method allows speakers relaxed utterance.
منابع مشابه
A Real-Time Approach to the Spotting, Representation, and Recognition of Hand Gestures for Human-Computer Interaction
Aiming at the use of hand gestures for human–computer interaction, this paper presents a real-time approach to the spotting, representation, and recognition of hand gestures from a video stream. The approach exploits multiple cues including skin color, hand motion, and shape. Skin color analysis and coarse image motion detection are joined to perform reliable hand gesture spotting. At a higher ...
متن کاملPerception and Synthesis of Biologically Plausible Motion: From Human Physiology to Virtual Reality
Temporal measures of hand and speech coordination during French cued speech production p. 13 Using signing space as a representation for sign language processing p. 25 Spatialised semantic relations in French sign language : toward a computational modelling p. 37 Automatic generation of German sign language glosses from German words p. 49 French sign language processing : verb agreement p. 53 R...
متن کاملHuman Computer Interface for Gesture-Based Editing System
The use of hand gesture provides an attractive alternative to cumbersome interface devices for human-computer interactio n(HCI). Many methods for hand gesture recognition using visual analysis have been proposed such as syntactical analysis, neural network(NN), Hidden Markov Model(HMM) and so on. In our research, a HMM is proposed for alphabetical hand gesture recognition. In the preprocessing ...
متن کاملA Proposal of Pattern Space Trajectory for Gesture Spotting Recognition
We propose a new appearance-based feature for real-time gesture recognition from motion images. The feature is the shape of the trajectory caused by human gestures, in the "Pattern Space" defined by the inner-product between patterns on frame images. It has three advantages, 1) it is invariant in term of the target human's position, size and lie, 2) it allows gesture recognition without interpr...
متن کاملMethods for Partial Sentence Recognition and Unknown Words Detection by Sentence Spotting on Continuous Speech
Spontaneous speech includes many sentences that fall outside the task domain. Furthermore, the boundary between sentences is often unclear in spontaneous speech because of the likes of corrections, stammering or overlap with the next utterance. We previously developed a sentence spotting system that uses Vector ContinuousDynamic Programming (VCDP). This system works well for sentence spotting i...
متن کامل